A comparison of user testing and heuristic evaluation methods for identifying website usability problems

This study compared the effectiveness and efficiency of two usability testing methods, user testing and heuristic evaluation. Thirty two participants took part in the study, sixteen for each of the two methods. Four measures were used to compare their performance: number of problems identified, severity of problems, type of problems and time taken to find problems. It was found that heuristic evaluation found nearly 5 times more individual problems than user testing, so could be seen as more effective. However, user testing found on average slightly more severe problems and took less time to complete than heuristic evaluation. Heuristic evaluation had a faster problem identification rate (number of seconds per problem found), so could also be seen as more efficient. While each method had advantages in the test both methods are seen as complementary to each other in practice

Designing citizen science tools for learning: lessons learnt from the iterative development of nQuire

This paper reports on a 4-year research and development case study about the design of citizen science tools for inquiry learning. It details the process of iterative pedagogy-led design and evaluation of the nQuire toolkit, a set of web-based and mobile tools scaffolding the creation of online citizen science investigations. The design involved an expert review of inquiry learning and citizen science, combined with user experience studies involving more than 200 users. These have informed a concept that we have termed ‘citizen inquiry’, which engages members of the public alongside scientists in setting up, running, managing or contributing to citizen science projects with a main aim of learning about the scientific method through doing science by interaction with others. A design-based research (DBR) methodology was adopted for the iterative design and evaluation of citizen science tools. DBR was focused on the refinement of a central concept, ‘citizen inquiry’, by exploring how it can be instantiated in educational technologies and interventions. The empirical evaluation and iteration of technologies involved three design experiments with end users, user interviews, and insights from pedagogy and user experience experts. Evidence from the iterative development of nQuire led to the production of a set of interaction design principles that aim to guide the development of online, learning-centred, citizen science projects. Eight design guidelines are proposed: users as producers of knowledge, topics before tools, mobile affordances, scaffolds to the process of scientific inquiry, learning by doing as key message, being part of a community as key message, every visit brings a reward, and value users and their time

The ABCD of usability testing

We introduce a methodology for tracking and auditing feedback, errors and suggestions for software packages. This short paper describes how we innovate on the evaluation mechanism, introducing an (Antecedent, Barrier, Consequence and Development) ABCD form, embedded within an eParticipation platform to enable end users to easily report on any usability issues. This methodology will be utilised to improve the STEP cloud eParticipation platform (part of the current STEP Horizon2020 project http://step4youth.eu. The platform is currently being piloted in real life contexts, with the participation of public authorities that are integrating the eParticipation platform into their regular decision-making practices. The project is involving young people, through engagement and motivation strategies and giving them a voice in Environmental decision making at the local level. The pilot evaluation aims to demonstrate how open engagement needs to be embedded within public sector processes and the usability methodology reported here will help to identify the key barriers for wide scale deployment of the platform

Biomarkers and Noncalcified Coronary Artery Plaque Progression in Older Men Treated With Testosterone.

ObjectiveRecent results from the Cardiovascular Trial of the Testosterone Trials showed that testosterone treatment of older men with low testosterone was associated with greater progression of noncalcified plaque (NCP). We evaluated the effect of anthropometric measures and cardiovascular biomarkers on plaque progression in individuals in the Testosterone Trial.MethodsThe Cardiovascular part of the trial included 170 men aged 65 years or older with low testosterone. Participants received testosterone gel or placebo gel for 12 months. The primary outcome was change in NCP volume from baseline to 12 months, as determined by coronary computed tomography angiography (CCTA). We assayed several markers of cardiovascular risk and analyzed each marker individually in a model as predictive variables and change in NCP as the dependent variable.ResultsOf 170 enrollees, 138 (73 testosterone, 65 placebo) completed the study and were available for the primary analysis. Of 10 markers evaluated, none showed a significant association with the change in NCP volume, but a significant interaction between treatment assignment and waist-hip ratio (WHR) (P = 0.0014) indicated that this variable impacted the testosterone effect on NCP volume. The statistical model indicated that for every 0.1 change in the WHR, the testosterone-induced 12-month change in NCP volume increased by 26.96 mm3 (95% confidence interval, 7.72-46.20).ConclusionAmong older men with low testosterone treated for 1 year, greater WHR was associated with greater NCP progression, as measured by CCTA. Other biomarkers and anthropometric measures did not show statistically significant association with plaque progression

Exploring orientation cues in both digital and physical books

Electronic books (eBooks) and eReaders are now a commonplace tool in the reading experience for many readers. Yet these have long received mixed reviews. Designing suitable interactions that support successful eReading experiences is a relevant task. This paper reports on an exploration of orientation cue designs for electronic books through consideration of design techniques implemented in both physical books (pBooks) and eBooks. We executed a case study of contemporary pBook and eBook orientation cue designs and report on the results of a heuristic evaluation with a small set of expert evaluators. Our findings identify the need for further investigation of the design of orientation cues for both pBooks and eBooks